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ABSTRACT 



The present invention provides a method and system for 
accelerating a user interface of an image capture unit. The 
method and system comprises providing a plurality of 
thumbnail images on the display, each of the plurality of 
thumbnail images being associated with a captured image. 
The method and system also include selecting one of the 
plurality of thumbnail images to be displayed as a resized 
thumbnail image on the display, the resized thumbnail image 
being a larger version of the selected one of the plurality of 
thumbnail images. Through the present invention the user 
interface allows a user to quickly review images in an image 
capture unit such as a digital camera or the like. 

26 Claims, 17 Drawing Sheets 
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METHOD AND SYSTEM FOR image slowly replace the previously displayed image from 

ACCELERATING A USER INTERFACE OF top to bottom. Due to the amount of processing involved, the 

AN IMAGE CAPTURE UNIT DURING display of the entire image may take several seconds in some 

REVIEW MODE cameras. Not only is the image decompression time slow, 

5 but conventional digital cameras also do not allow other 

CROSS-REFERENCE TO RELATED camera operations while the JPEG image is being 

APPLICATIONS decompressed, which means that the user cannot abort the 

„ . r „ decompression process. Thus, if the user decides halfway 

The present invention is related to he following , h h reviewin , eamul to thal another ^ e is 

co-pending ^U.S. patent applications Ser. No. 08/872,651 ,„ pre f 6 rred, the camera will not recognize the next action until 

entitled A Method And Systein For Generating An ^ curreQt ^ ^ m ^ t d . 

Enhanced Image File In An Image Capture Unit; Ser. No. ... • , , , . ... 

08/872,578 entitled "A Method And System For Accelerat- Accordingly a user interface of this type appears to the 

ing A User Interface Of An Image Capture Unit During Play user 35 being slow and non-responsive when attempting to 

Mode;" and Ser. No. 08/872,588 entitled "A Method And « acc « ss multl P le f 14 ?* on a camera - S P eed of ac L cess 

System For Speculative Decompression of Compressed 15 '° these images has become increasmgly important as these 

Image Data In An Image Capture Unit," which are assigned of cameras have become more 

to the assignee of the present application and filed on the There is a need, therefore, to provide images on a display 

same date as the present application. device which allows the user to review multiple captured 

images, while simultaneously providing a display and a 

FIELD OF THE INVENTION 20 readout for a particular image in an efficient and straight- 
forward manner. It is similarly important to be able to 

The present invention relates generally to an image cap- rapidly identify a re0 o gnizable representation of the image, 

ture unit and more particularly to a method and system for Finally> thc system and melhod should be more rcsponsiv6 

accelerating a user interface m such a unit. tQ the user to p re yj ous i y known systems. For example, in 

BACKGROUND OF THE INVENTION " 'f™ 1 ^ ° f j l would be ux ™ to ^ 

identify two or more particular images quickly, with a 

Modern digital cameras for taking pictures of scenes and minimum of effort. It is also important to provide more 

the like typically include an imaging device which is con- efficient ways to quickly navigate through a series of images, 

trolled by a computer running a single threaded process. The system should be implementable in a simple and cost 

When an image is captured, the imaging device is exposed 30 effective fashion and should be easily handled by a user. The 

to light and generates raw image data representing the present invention addresses such a need, 

image. The raw image data is typically stored in a single cnm , ADV nc TOt , 

image buffer where it is then processed and compressed by SUMMARY OF THE INVENTION 

the processor. Many types of compression schemes are used 3s jh e present invention provides a method and system for 

to compress the image data, with the joint photographic accelerating a user interface of an image capture unit. The 

expert group (JPEG) standard being the most popular. After method and system comprises providing a plurality of 

the processor processes and compresses the raw image data thumbnail images on the display, each of the plurality of 

into JPEG image files, the processor stores the JPEG image thumbnail images being associated with a captured image, 

files into an internal memory or on an external memory card. ^ The me thod and system also include selecting one of the 

Some digital cameras are also equipped with a liquid- plurality of thumbnail images to be displayed as a resized 

crystal display (LCD) or other type of display screen on the thumbnail image on the display, the resized thumbnail image 

back of the camera. Through the use of the LCD, the being a larger version of the selected one of the plurality of 

processor can cause digital camera to operate in one of two thumbnail images. Through the present invention the user 

modes, record and play, although some cameras only have a 45 interface allows a user to quickly review images in an image 

record mode. In record mode, the LCD is used as a view- capture unit such as a digital camera or the like, 
finder in which the user may view an object' or scene before 

taking a picture. In play mode, the LCD is used a playback BRIEF DESCRIPTION OF THE DRAWINGS 

screen for allowing the user to review previously captured piG. 1 is a block diagram of a digital camera that operates 

images either individually or in arrays of four, nine, or 5Q m accordance with the present invention, 

sixteen images. FIG. 2 is a block diagram of one preferred embodiment 

Besides the LCD, digital camera user interfaces also f or tne imaging device of FIG. 1. 

include a number of buttons or switches for setting the FIG. 3 is a block diagram of one preferred embodiment 

camera into one of the two modes and for navigating for the computer of FIG. 1. 

between images in play mode. For example, most digital 55 rT „ . A . , . r j _u j* 

. . & , *l ; , . 1 j« „ j« . FIG. 4A is a memory map showing the preferred embodi- 

cameras include two buttons labeled - and + that enable . . ~ . *L * a w /^nAw\ 

. , „ 4 . , , . „ ment of the Dynamic Random-Access-Memory (DRAM), 

a user to navigate or scroll through captured images. For .„ . . c 

example, if the user is reviewing images individually, mean- FIG - 4B 15 a block dia S ram illustrating the contents of one 

ing that single images are displayed full-sized in the LCD, of tne in P ut buffere and ^ contents of the frame buffer, 

pressing one of navigation buttons causes the currently 60 FIGS. 5A and 5B are diagrams depicting the back and top 

displayed image to be replaced by the next image. view, respectively, of digital camera. 

To display a captured image in play mode, the processor FIG. 6 is a block diagram illustrating an enhanced format 

must first access the JPEG image file corresponding to the of still image file in accordance with the present invention, 

captured image from memory, decompress the image data FIG. 7 is a block diagram illustrating the image file 

sixteen horizontal fines at time, and then send the decom- 65 generation process, which begins when the camera is in 

pressed data to the LCD. When the user presses the navi- capture mode and the user presses the shutter button to 

gation button to see the next image, the user sees the next capture an image. 
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FIG. 8 is a diagram illustrating the operation and appear- 116 to capture raw image data representing object 112. The 

ance of the accelerated user interface during review mode in captured raw image data is transferred over system bus 116 

accordance with a preferred embodiment of the present to computer 118 which performs various image processing 

invention. functions on the image data before storing it in its internal 

FIG. 9 is a flow chart illustrating the process of acceler- * memory. System bus 116 also passes various status and 

ating the user interface of the digital camera when in review control signals between imaging device 114 and computer 

mode. 118 - 

FIG. 10 is a diagram illustrating the operation and appear- Referring now to FIG. 2, a block diagram of one preferred 

ance of the accelerated user interface during play mode in embodiment of imaging device 114 is shown. Imaging 

accordance with a preferred embodiment of the present 10 dev i ce U4 typically comprises a lens 220 having an iris, a 

invention ^ ter ^22, an image sensor 224, a timing generator 226, an 

FIG. 11A is a flow chart illustrating the process of "»J»B si S nal P ro J?* 01 < ASP ) 22S >™ analog-to-digital 

accelerating the user interface of the digital camera when in W «>° verter 230 ' an mterface 232 > and one or more 

play mode motors 234. 

FIGS. 11B, UC, and 11D illustrate an example of a cI^op^on,4maging deyice Hi captures^anamage of, 

screennail displayed on an LCD screen and then updated object-m.via.reflected.hght^p^ 

with a highcr-resolution image as the higher-resolution ^ ^ S^^^*^^^^j3*y«f^ 

image is decompressed in accordance with the present a-charged.c^pled device ^ 

®. set-oPraw image-data in CCD format representing -the 

invention. 20 • m . t . 

captured imagerll2._The raw image-data-is then routed^ 

FIG. 12 is a memory map of the DRAM illustrating the mrough^ASP-228r A/D converter 230-and z interfacc"232P 

reallocation of the input buffers as speculation buffers in Interface 2 32 has outputs for controlling ASP 228, motors 

accordance with the present invention. 234 and timmg generator 2 26. From interface 232, the raw 

FIG. 13 is flow chart depicting the speculative decom- image data passes over system bus 116 to computer 118. 
pression process in a preferred embodiment of the present w Referring now to p IGi ^ a b]ock diagram of one preferred 

invention. embodiment for computer 118 is shown. System bus 116 

FIGS. 14 A and 14B are block diagrams illustrating the provides connection paths between imaging device 114, an 

buffer organization that is assigned to images in response to optional power manager 342, central processing unit (CPU) 

automatic and manual scrolling methods, respectively. 344, dynamic random-access memory (DRAM) 346, input/ 

FIG. 15 is a flow chart illustrating the process of accel- output interface (I/O) 348, non-volatile memory 350, and 

erating the user interface of play mode using the speculative buffers/connector 352. Removable memory 354 connects to 

decompression process. system bus 116 via buffers/connector 352. Alternately, cam- 
era 110 may be implemented without removable memory 

DETAILED DESCRIPTION OF THE ^ 354 or buffers/connector 352. 

INVENTION Power manager 342 communicates via line 366 with 

The present invention relates to a method and system for power supply 356 and coordinates power management 

accelerating the review and navigation through a series of operations for camera 110. CPU 344 typically includes a 

images on an image capture unit. The following description conventional processor device for controlling the operation 

is presented to enable one of ordinary skill in the art to make 4Q of camera 110. In the preferred embodiment, CPU 344 is 

and use the invention and is provided in the context of a capable of concurrently running multiple software routines 

patent application and its requirements. Although the present to control the various processes of camera 110 within a 

invention will be described in the context of a digital multithreaded environment. DRAM 346 is a contiguous 

camera, various modifications to the preferred embodiment block of dynamic memory which may be selectively allo- 

will be readily apparent to those skilled in the art and the 45 cated to various storage functions. LCD controller 390 

generic principles herein may be applied to other embodi- accesses DRAM 346 and transfers processed image data to 

ments. That is, any image capture device which displays LCD screen 402 for display. 

images, icons and/or other items, could incorporate the I/O 348 is an interface device allowing communications 

features described hereinbelow and that device would be to and from computer 118. For example, I/O 348 permits an 

within the spirit and scope of the present invention. Thus, the 50 external host computer (not shown) to connect to and 

present invention is not intended to be limited to the embodi- communicate with computer 118. I/O 348 also interfaces 

ment shown but is to be accorded the widest scope consistent with a plurality of buttons and/or dials 404, and an optional 

with the principles and features described herein. status LCD 406, which in addition to the LCD screen 402, 

The present invention is a method and system for accel- are the hardware elements of the camera's user interface 

erating a graphical user interface of an image capture unit 55 408. 

using expanded image files that allow for the rapid display Non-volatile memory 350, which may typically comprise 

of captured images. a conventional read-only memory or flash memory, stores a 

Referring now to FIG. 1, a block diagram of a digital set of computer- readable program instructions to control the 

camera 110 is shown for use in accordance with the present operation of camera 110. Removable memory 354 serves as 

invention. Camera 110 preferably comprises an imaging 60 an additional image data storage area and is preferably a 

device 114, a system bus 116 and a computer 118. Imaging non-volatile device, readily removable and replaceable by a 

device 114 is optically coupled to an object 112 and elec- camera 110 user via buffers/connector 352. Thus, a user who 

trically coupled via system bus 116 to computer 118. Once possesses several removable memories 354 may replace a 

a photographer has focused imaging device 114 on object full removable memory 354 with an empty removable 

112 and, using a capture button or some other means, 65 memory 354 to effectively expand the picture -taking capac- 

instructed camera 110 to capture an image of object 112, ity of camera 110. In the preferred embodiment of the 

computer 118 commands imaging device 114 via system bus present invention, removable memory 354 is typically 
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implemented using a flash disk. Power supply 356 supplies 
operating power to the various components of camera 110. 
In the preferred embodiment, power supply 356 provides 
operating power to a main power bus 362 and also to a 
secondary power bus 364. The main power bus 3 62 provides 
power to imaging device 114, I/O 348, non-volatile memory 
350 and removable memory 354. The secondary power bus 
364 provides power to power manager 342, CPU 344 and 
DRAM 346. 

Power supply 356 is connected to main batteries 358 and 
also to backup batteries 360. In the preferred embodiment, 
a camera 110 user may also connect power supply 356 to an 
external power source. During normal operation of power 
supply 356, the main batteries 358 provide operating power 
to power supply 356 which then provides the operating 
power to camera 110 via both main power bus 362 and 
secondary power bus 364. During a power failure mode in 
which the main batteries 358 have failed (when their output 
voltage has fallen below a minimum operational voltage 
level) the backup batteries 360 provide operating power to 
power supply 356 which then provides the operating power 
only to the secondary power bus 364 of camera 110. 

Referring now to FIG. 4A, a memory map showing one 
embodiment of dynamic random-access-memory (DRAM) 
346 is shown. In the preferred embodiment, DRAM 346 
includes RAM disk 532, a system area 534, and working 
memory 530. 

RAM disk 532 is a memory area used for storing raw and 
compressed image data and typically is organized in a 
"sectored" format similar to that of conventional hard disk 
drives. In the preferred embodiment, RAM disk 532 uses a 
well-known and standardized file system to permit external 
host computer systems, via I/O 348, to readily recognize and 
access the data stored on RAM disk 532. System area 534 
typically stores data regarding system errors (for example, 
why a system shutdown occurred) for use by CPU 344 upon 
a restart of computer 118. 

Working memory 530 includes various stacks, data struc- 
tures and variables used by CPU 344 while executing the 
software routines used within computer 118. Working 
memory 530 also includes several input buffers 538 for 
temporarily storing sets of raw image data received from 
imaging device 114, and a frame buffer 536 for storing data 
for display on the LCD screen 402. In a preferred 
embodiment, each input buffer 538 and the frame buffer 536 
are split into two separate buffers, called ping-pong buffers 
(shown by the dashed lines), to improve the display speed of 
the digital camera and to prevent the tearing of the image in 
the display 402. 

Referring now to FIG. 4B, the contents of one of the input 
buffers 538 and the contents of the frame buffer 536 are 
illustrated. As shown, each input buffer 538 includes an 
input buffer A and an input buffer B, and the frame buffer 
536 includes a frame buffer A and a frame buffer B. The 
input buffers A and B alternate between an input cycle and 
a processing cycle. During the input cycle, the input buffers 
538 are filled with raw image data from the image device 
114, and during the processing cycle, CPU 344 processes the 
raw data and transmits the processed data to the frame 
buffers 536. 

Referring now to FIG. 7, in a preferred embodiment, the 
processing is performed by a live view generation process 
612, which is stored in non-volatile memory 350 and 
executed on CPU 344. However, the image processing can 
also be implemented using hardware. During the execution 
of the live view generation process 612, the CPU 344 takes 
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the raw image data from the input buffers 538, typically in 
CCD format, and performs color space conversion on the 
data. The conversion process performs gamma correction 
and converts the raw CCD data into either a RGB or YCC 
color formal which is compatible with the LCD screen 402. 
(RGB is an abbreviation for Red, Green, Blue, and YCC is 
an abbreviation for Luminance, Chrominance-red and 
Chrominance-blue). After converting the data to YCC, the 
YCC image data is stored in the frame buffer 536. The LCD 
controller 390 then transfers the processed image data from 
the frame buffers to the LCD screen 402 for display. 

The resolution of the LCD screen 402 may vary; however, 
the LCD screen resolution is usually much less than the 
resolution of the image data that's produced by imaging 
device 114 when the user captures an image at lull resolu- 
tion. Typically, the resolution of LCD is % the video 
resolution of a full resolution image. The size of the input 
buffers 538 may also vary, but in a preferred embodiment, 
two of the input buffers 538 are required to contain a full 
resolution image. One input buffer 538 can therefore contain 
one image captured at Vi resolution. Since the LCD is 
capable of displaying images at Vi resolution, the images 
generated during the live view process are also Va resolution 
and are therefore be stored in one -half, or in one of the 
ping-pong buffers of an input buffer 538. 

Referring again to FIG. 4B, the ping-pong buffers are 
utilized during live view mode as follows. While input 
buffer A is filled with image data, the data from input buffer 
B is processed and transmitted to frame buffer B. At the 
same time, previously processed data in frame buffer A is 
output to the LCD screen 402 for display. While input buffer 
B is filled with image data, the data from input buffer A is 
processed and transmitted to frame buffer A. At the same 
time, previously processed data in frame buffer B is output 
to the LCD screen 402 for display. 

FIGS. 5A and 5B are diagrams depicting the preferred 
hardware components of the camera's 110 user interface 
408. FIG. 5 A is back view of the camera 110 showing the 
LCD screen 402, a four-way navigation control button 409, 
an overlay button 412, a menu button 414, and a set of 
programmable soft keys 416. FIG. 5 B is a top view of the 
camera 110 showing a shutter button 418, and a mode dial 
420. The camera may optionally include status LCD 406, 
status LCD scroll and select buttons 422 and 424, a sound 
record button 426, and zoom-in, zoom-out buttons 426a and 
426b. 
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camela^theuse^of-multiple thumbliail images forsuppof ting 

tHe^Tapid^isplay of-images^by~elimin^tmg -th^-nee'd=to 

decompress r image"dal^irKcertain~operatmg-modesp=and^ 

spe^ative de«^^^ 

supporting the rapid^display-of-fjaltei 

operaunX-mollesrThe'us^ofcthum 

llecompression~enables^the^images -to-be- reviewed "and 

navigated more ^idly^via-representatio ns^which^ca n^be 1 

displaj^^ickl^ThTcmg^ 

action~7aHe~luS~Telponsive'n^^ 

significanQy-over-conventionalrnavigation'systems. 

As stated above, in one aspect of the present invention, the 
digital camera is provided with several different operating 
modes for supporting various camera functions. Although 
the digital camera includes multiple operating mode, the 
modes relevant to this description are capture (record), 
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review, and play mode. In capture mode, the camera 100 
supports the actions of preparing to capture an image, and 
capturing an image through the use of either the LCD screen 
402 alone or the status LCD 406 with the aid of an o ption al 
optical viewfinder (not shown) .lirrevie w-modefthe'camefa 
l$2zSupportS; the _ acti ons o f reyiewin^camera-contentsT 
editing-aifd^orting-images^an^ 
im age^In^play^n^d^ 

vie^-^creen-si2ed^images-in_the LCD z screen=402-irFth"e 
orienUtioli-trmtJliOmag^ 

allows -the -user— to =he ar-recorded= sound-associatedr to^a 
•displayep^mage,-andzto~playrbackTsequential-groupingS*of 
*images,"Wmchrrj^y : -comp^ 

<c:burst-image r images3=»The user preferably switches between 
the capture, review, and play modes, using the mode dial 
420. When the camera is placed into a particular mode, that 
mode's default screen appears in the LCD screen 402 in 
which a set of mode-specific items, such as images, icons, 
and text, are displayed. Through the use of multiple oper- 
ating modes, the camera functions and features can be 
categorized, which allows for faster access to those features 
and functions than would be possible by nesting all the 
features in one play mode as in conventional digital cameras. 

(AnotheTasl)e^t^f-th^_ra 
accelerationof ^e-user-interface^08 is-the_use-of-multipje 
fthu mbnail s associated with eacrTcaptufed image, .which-are r 

^smana^duced-resolutiogversionsof the h igh^rfresblution 
compressed-image -jdataTELa ^preferredLembodiment" ofcthe 

^resent.mv.eMblartw^ 
ciatell-v^tti-each-captured^ 
image's data_file;. 

Referring-now-to:HG^,4iJ^ck^ 
forma^of-stiU-imager file-^m ^ 

inv entio n -i s 2 sho wn r=The-image-file- 600zincludes = a z header 
602^c^ presse drimage-data:604r.a.thumbnaiLimage=606^a" 
scnsejuiaiL608,~aird r a^ 

600 ma y also:include T a sound;file:(not shown) df-a-sound clip= 
h'as-beTn^achel3 = t^ 

TCe-header~602-iricludes :inform ation:identifyiDg:tj^p^ 
ueularimage:filelaMnhe 4^ 

cdata:604rTh^mageAta-6.0ibi^^^ 
cthe-fM=sized~captured~imagenn^com^ ^ 

ablyJIn^EGformal^tfiough "mT_iisercarrtypically;cteose 
ahe^resolutionrmodeimzwmcn-images^in^^ 

image^^c^eji^andxompr^^ 

; dat a z 604 is ^ e,high-r^olution:rcpresentatiQn-of:me:image 
compared:to~tht^tmimbnaik^ 

imageZisrcaptured=at"a-resoluti6n of 640x480 z pixels,— for* 
exalnplepmen-me-compressedrimage-da 
fifty^to^sixty-kilobytesiinrsize. 

The mumbnan-image_J>06js^^ 
re^olutoilversion oj;mXimage/In^ preferred embc^iment, 
thejpjxjel siz^fjl^^ 

sizTo£thT-LC D scree n 40 2"^g ^0x60 ;pixels),"and:has:a 
stqragelsizelof-approximately'ten kilobytes. 

fiie T s^eelmail:image:608:is;a:me&^ 
of-tKe i -imagerand-in-a-preferredrembodimentr: is^so 
cc^press^Falmough-cj>mpra 
optionafcUnlil^the-miuiibnan^ 
image;;608;;is^disj)lay-siz^ 

LCDrscreen^402-when-displayed.— In-a— preferred 
embodiment,- the-pLxel-size-of-a-compressed- screennail^ 

image~6j)8-is^pref^aj^ 

mately"fifteen=kilobytes-to=store^» 65 

Th^ifna^tag~field : 6104ncludes:inforrMti 
m-me_form-of~tags,-regarcUng-meJmage_reD^^ 



image"data-604rMe^a"typetagsrfoT : irBtan(»rMicate-all 
th^ln&ctiaUype^ 

the r image-is-a^ingle _ im^e-or _ a- panoramazim age^rf or^" 
examplcr-Incertain operatiire:modes. -thc-media t ype-tagsaie^. 
5 ciised;to=sele'ct : mi^type:of:icon-mat r is r <iis^ 

4023along^ide^thKtombnaildmage~606rrBesidesrmcdw 5t 
tags,„me:uBagej.ag;field;610:may-alsoincluAe:ot^ 
tal^f6r3tca^g:a^ditiona^^ 
<aWor z tfie^«mTe7a^^ 
10 used : to ; maicate:tbe : settinlpof-m^^ 

image -was c^ptured^or-indicate thejj^^ 
im anufactj u^dfor:: 

may : be^accessed:mrough:the;buttonston:the:camerainterface 
^OO.-The^adm^onal-inforraation-ma^^ 
15 eithexjtsJej^n:the^LCD^402. 

The enhanced image file 600 of the present invention is 
created for each image as the user takes pictures while the 
camera is in capture mode. The enhanced image file 600 is 
then used to accelerate the user interface of the digital 
camera in the review and play mode as follows. ^hen~the 
cameja-is-placeoynto;irev^^ 
^6rcont£neiHnjJi^im^ 

on:ifcLCD^4^a^represen^^ images^ 
wj^hlelimmatesltoelneed^ 
compres^drimage.data_6j^^^ 

intop_lay^mode,-the-screennail -image-608^containecUiir the 
draige-fite- 600-^ 
LGb-4b2^arfd7men~opti^ 

res olution c ompressed image data-604 as image data jjQ43 
is *bemg ~deco mpressed-. This feature enables the digital 
camera to quickly display a full-sized version of the cap- 
tured image in the LCD 402 without the delay incurred by 
first decompressing the higher-resolution JPEG image and 
resizing it to fit on the LCD 402. Whether or not to 
decompress and display the compressed image data 604 
depends on the resolution of the display and the resolution 
of the screennail images 608, which is explained further 
below. 

Referring now to FIG. 7, a block diagram is shown of the 
image file generation process, which begins when the cam- 
era is in capture mode and the user presses the shutter button 
418 to capture an image. As described above, before the user 
captures an image in capture mode, frames of raw image 
data are sequentially captured by the imaging device 114 at 
a reduced resolution suitable for LCD screen 402, and each 
of the frame of the raw image data are stored in the 
ping-pong buffers (FIG. 4B) of an input buffer 538. The live 
view generation process 612 performs gamma correction 
and color conversion on the raw image data to convert the 
data into the YCC format of the LCD screen 402, typically 
YCC 222 format, and then transfers the YCC 222 data for 
each frame to the frame buffers 536 for display. The raw 
image data placed into the input buffers 538 is also pro- 
cessed for extracting exposure, focus, and white balance 
settings. 

Once the user presses the shutter button 418 to capture an 
image, the raw image data is captured by the image device 
114 at a resolution set by the user and the raw image data is 
stored into an appropriate number of input buffers 538. 

The raw image data is then used to generate an enhanced 
image file 600 for the captured image including the com- 
pressed image data 604, the thumbnail 606, and the screen- 
nail 608, as shown in FIG. 6. 

When generating the thumbnail and screennail images 
606 and 608, the present invention takes advantage of the 
fact that the YCC data in the frame buffers 536 has already 
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been processed by the live view generation process 612 and 
stored at the reduced resolution of the LCD screen 402. 
Since the thumbnail and screennail images 606 and 608 are 
also intended to be lower-resolution representations of the 
captured image, the previously processed YCC data in the 5 
frame buffers 536 is used to generate the thumbnail 606 and 
screennail 608 directly, rather than using the raw image data 
stored in the input buffers 538. 

To generate the screennail image 608, the YCC data in the 
frame buffers 536 is converted from YCC 222 format into 10 
YCC 422 format and compressed by a conversion and 
compression process 614. To generate the thumbnail image 
606, the YCC data in the frame buffers 536 is converted from 
the YCC 222 format into YCC 422 format and then resized 
by a conversion and resizing process 616. During the 15 
conversion and resizing process 616, the thumbnail image 
606 may be resized by averaging in which a block of pixel 
values from the YCC 422 data are averaged to represent one 
pixel value of the thumbnail image 606, and/or by sub- 
sampling the YCC 422 data in which only a certain number 20 
pixels in a block are used to represent one pixel in the 
thumbnail image 606. 

Referring now to FIGS. 4A, 6 and 7, after the thumbnail 
image 606 and the screennail 608 are generated, they are 
stored in working memory 530 until the compressed image 
data 604 is generated. The compressed image data 604 may 
be generated either before or after the thumbnail and screen- 
nail images 606 and 608. However, in a preferred 
embodiment, the compressed image data 604 is generated 
after the thumbnail and screennail images 606 and 608 are 
generated using a background spooling process 618. In an 
alternative embodiment, the thumbnail image 606 and the 
screennail 608 may be generated by the background spool- 
ing process 618 along with the compressed image data 604. 

In another preferred embodiment, the thumbnail image 
606 and the screennail 608 may be generated using a 
two-stage live view generator 612. In the first stage, the live 
view generator 612 provides images to the frame buffer 536 
for display as described above. When the user captures an 
image, the raw image data from the imaging device is 
compressed due to higher quality before being stored in the 
input buffers 538, and the live view generator 612 switches 
to the second stage. In this stage, the live view generator 612 
decompresses the compressed raw image data and processes 
the data into both YCC 222 data and YCC 422 data. The live 
view generator 612 may then transfer the YCC 422 data to 
the frame buffer 536 for display, and generate the thumbnail 
image 606 and the screennail 608 from the YCC 422 data. 

The background spooling process 618 preferably includes 
RAM spoolers 1 and 2 (620), removable memory spoolers 
1 and 2 (624), and an image processing and compression 
process (IPC) 622. Processes 620, 622 and 624 are prefer- 
ably implemented as background processes on CPU 344 and 
may therefore run in parallel with other processes. As used 
herein, a spooler is a process that transfers data from one 
process or device to a second process or device. The primary 
purpose of the background spooling process 618 is to move 
data out of the input buffers 538 as fast as possible in order 
to free the input buffers 538 to capture another image. After 60 
the data is moved, the data is processed in the background. 
This allows the next image to be captured before the 
previous image is processed and compressed, which 
increases the capture rate of the digital camera. 

In operation, after the user has captured an image, control 65 
of the raw image data in the input buffers 538 is transferred 
to RAM spooler 1 (620) if the RAM disk 532 is not full. If 
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the RAM spooler 1 (620) obtains control of the raw image 
data, then the RAM spooler 1 (620) transfers the raw image 
data to the RAM disk 532. Alternatively, if the RAM disk 
532 is full, then control of the raw image data is transferred 
to the IPC 622 where the data is processed and compressed 
to generate the compressed image data 604 (FIG. 6). 

In the case where the raw image data has been transferred 
to the RAM disk 532, the removable memory spooler 1 
(624) may then access the raw image data from the RAM 
disk 532 and transfer it to the removable memory 354. Once 
the raw image data is transferred to the removable memory 
354, the IPC 622 accesses the raw image data and processes 
the raw image data to generate the compressed image data 
604. Alternatively, if the removable memory 354 is full or is 
not present, then the removable memory spooler 1 (624) 
may provide the raw image data directly to the IPC 622 for 
generation of the compressed image data 604. 

After the compressed image data 604 is generated, the 
IPC 622 may provide the compressed image data 604 to the 
RAM spooler 2 (620). The compressed image data 604 is 
then combined with the thumbnail 606 and the screennail 
608 to generate the enhanced image data file (FIG. 6), and 
the RAM spooler 2 (620) transfers the compressed image 
data file 600 to the RAM disk 532. Once the image data file 
600 is written to RAM disk 532, the removable memory 
spooler 2 (624) may then access the image data file 600 and 
write the image data file 600 onto the removable memory 
354. If the removable memory 354 is not inserted, the image 
data file 600 remains on the RAM disk 532. It should be 
noted that in an alternative embodiment, the digital camera 
may be implemented without a RAM disk 532, in which 
case the image data would be spooled to and from the 
removable memory 354. 

the present-mvent^Ctb^accxleratezthe-use rJnterface^fJth e 
review:mode-and-the-play-mode-of~the-digital-camera-are 
descnbedjbelow. 

Refelfuig^TioAv^t^ 
operation=and=appearance-ofztheraccelerate"d"user _ interface 
durmgrreview-mode^shown-m^accordance^with^preferred 
embodlmentjDf.me- presentin y&^UoDr:Moving:the mode^dial 
420=(FlG^5B);or-omer~suchzbutton^ 
mode:enables-the-user-to"-\aew^ r rfienm 
along--Vitith:specific : attributes=assocte 
eimageSrlQ^preferredembodmienj j-the.reyie ^^cxeenJayout 
displays-four-smaMhuinbnailsrTOO-ata^ 
a c filmstfip : lnetapho 

forwarci-and"backward-among-pic^^ 
accordmgjojdate^and^time . 

The user may navigate through the series of small thumb- 
nails 700 in the LCD screen 402 using the four- way navi- 
gation control button 409. When the user depresses or holds 
down the left/right buttons 410, the small thumbnails 700 are 
scrolled-off the LCD screen 402 and replaced by new small 
thumbnails 700 representing other captured images to pro- 
vide for fast browsing of the camera contents^^tAt^ria^ 
selection-arrow'Une-702"is u^d^"botrra^navi gational ai cl 
Vo^Zjgj-^ig^ tc ~ ^^ ^^^S g^ l =r ttiumb5 ai 1 J70 OlisAhe- cxirren tly 
sele^djmageTTAs-fellu^^ 
4]U^and=th~e~slnlQntl^ 

^creen^^27th"e^small thumbnail JOOrtMtlis^g^ione^dlbver 
a^se]ecti^;jn^^atio is 
corisjdereliItrje_c^ In an alternative 

embodiment, the selection indication is stationary except 
when positioned near the beginning and the end of the image 
list. 
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In a preferred embodiment, when no captured images are multiplying the thumbnail image 606 by a multiplication 
available in the camera, the LCD 702 displays a message factor, such as 15, which effectively increases the image 
indicating this to be the case. When only one image is size by 2.25. Rather than expanding the thumbnail image 
available, then the small thumbnail 700 representing that 606, the resized thumbnail 704 could also be generated by 
image is displayed above the selection indication in the 5 expanding the small thumbnail 700. Since the small thumb- 
selection arrow line 702. And when there are more than four nail 700 is cropped to a square size, however, expanding the 
images in the camera, the selection arrow line 702 displays original thumbnail image 606 provides a better representa- 
arrow heads to indicate movement in that direction is tional view of the selected image as it indicates the true 
possible with the left/right navigation buttons 410, orientation of the image. 

After^a-smalPthurnb^iK-700=becomes-the^currently ™ After the resized thumbnail 704 is written, additional 

sslectedamager addiUonal-Mormato information regarding to the selected image is written into 

image7is^tbWaticaUy:dispJayed:ffl^ the draw buffer in step 728. The additional information is 

^prefer red embodiment rme;aQMitional:infonnahorrih^lude's displayed by accessing the image tags 610 from the image 

arresized_mumbnail„704"sh~6vmg-a^ file 600 corresponding to the selected image. After the draw 

pixels Vof me cuirenU v-selectediim^^ 15 buffer contains all the necessary screen elements, the con- 

tioji-c^pjisjng;an : ira^ tents of the draw buffer are moved to the display buffer and 

may-display-several icons- indicaUnj^mermediaaypj^assor then output to the LCD 402 in step 730. 

ciated^frjhe:active-in^ As the user scrolls through the small thumbnails in the 

a-stillra-time^apseT^a- LCD 402 in step 730, then the next thumbnail image 606 to 

attaclred;no J: thej^age^and^ 20 be displayed is fetched from its image data file 600 and 

displayed;tejar708:mayjmclnde-a:specificatign^>fzthe=name placed into working memory 530 as described with refer- 

o^umberof;mc;imagerand:meri eace to step 722 and the process repeats. In one preferred 

captured. embodiment, if the user holds down the left/right navigation 

Referring now to FIG. 9, a flow chart illustrating the button 410, the resized thumbnail 704 is updated as the 

process of accelerating the user interface of the digital 25 selected image changes, and the small thumbnails 700 scroll 

camera when in review mode is shown in accordance with only as fast as the resized thumbnail 704 can be updated. In 

the present invention. The process begins once review mode another preferred embodiment, the resized thumbnail 704 is 

is invoked in step 720. Referring now to FIGS. 3, 6, 8, and not updated with each new selected image, and the small 

9, after review mode is invoked, each of the thumbnail thumbnails 700 rapidly move across the screen at a pre- 

images 606 to be displayed in the current screen are fetched 30 defined rate in a smooth scroll, rather than in incremental 

from the corresponding image data files 600 stored on the jumps. In this embodiment, the resized thumbnail 704 is 

removable memory 354 (or a host computer if connected) in updated once the user releases the left/right navigation 

step 722. button 410 to stop scrolling. 

To further increase the display speed of the user interface, 35 In accordance with the present invention, both small and 

one of the frame buffers 536 shown in FIG. 4B is used as a large thumbnail 700 and 704 are displayed in the review 

dedicated draw buffer and the other as a dedicated display mode using the thumbnail image data 606. Since no JPEG 

buffer in a preferred embodiment of the present invention. decompression is necessary to display the thumbnails 700 

When displaying a given review mode screen, all the screen and 704, image display time and responsiveness of the user 

elements are first drawn in the draw buffer and then moved 40 interface is significantly increased. And since the resized 

to the display buffer where the data is then output to the LCD thumbnail 704 is displayed along with the small thumbnails 

402 for display. 700, the user can easily identify a given image while 

After a thumbnail image 606 is fetched and placed into maintaining the ability to scroll through the images.^ 

working memory 530, the thumbnail image 606 is cropped t In"altemative"em blo^ 

to generate a small thumbnail 700, and the small thumbnail 45 ^media^iOIhM 

700 is written into the draw buffer in step 724. In one ^plemented.by-cachmg:a^eJLof;^ 

preferred embodiment, the small thumbnails 700 are gener- wor^glffiemofyf The process could also be implemented 

ated by cropping the center of thumbnail image 606 to a without partitioning the frame buffers 536 into a draw and 

square size (50x50 pixels) irrespective of image orientation display buffer, and could be implemented instead by swap- 

before being displayed. This is done because the small 50 ping ping-pong buffers. However, it is believed the preferred 

thumbnails 700 are intended to serve as navigational aides embodiment will result in performance gains because only 

rather than accurate representations of their images and the elements of the screen that change are redrawn in the draw 

square size reduces the amount of space in the LCD 402 that buffer, while the background and other screen elements that 

would be required to support the display of both landscape remain constant and are not redrawn, which saves time and 

and portrait thumbnail images. In an alternate embodiment, 55 frees processing cycles for other tasks, 

the thumbnails 700 may be displayed in the LCD 402 in their Referring now to FIG. 10, a diagram illustrating the 

true orientation and aspect ratio (portrait or landscape). In operation and appearance of the accelerated user interface 

another embodiment, the thumbnails may also be displayed during play mode is shown in accordance with a preferred 

in landscape format and may be cropped or uncropped to embodiment of the present invention. Moving the mode dial 

resemble images laid out on a conventional wet film nega- 60 420 (FIG. 5B) or other such button to access the play mode 

tive. enables the user to view full-sized images and to play-back 

After all the small thumbnail images 700 are written into various media types associated with the images. In a pre- 

the draw buffer, the thumbnail image 606 associated with the ferred embodiment, the play screen layout displays one 

currently selected image is resized to generate the larger full-sized image at a time in the orientation that the image 

resized thumbnail 704 and the resized thumbnail 704 is 65 was captured. As in the review mode, the user may chro- 

written into the draw buffer in step 726. In a preferred nologically navigate through the full-sized images in the 

embodiment, the resized thumbnail 704 is generated by LCD screen 402 using the left/right buttons 410 on four-way 
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navigation control button 409. Users can also play back 
various media types, such as time lapse, bursts and slide 
show images according to either default or user defined play 
back rates. 

Referring now to FIG. 11A a flow chart illustrating the s 
process of accelerating the user interface of the digital 
camera when in play mode is shown in accordance withjhe 
present invention. The::process~begihs-once~play-mode"is 
invoked:in^^p_^OcReferring:now to-nGSr^^pand-10; r 
,af^pjlay^g^e^is:invj>^^ 10 
c respontog 

data ^fite^6^^red^n Uie remo vable me^6Ty:354:(or:Chost 

computecif-^nnecte^)^^ 

608:is~4hen~.derompra^d;andrdisp^ 

£O2:in:step^804. is 

nGrrliB=illustrates-an=exampler=of~a-screennail-809 
d^played-onithejJ^D-sc^ 
809Js;GnLyjnedium-resgjuj^ 
hut-is^j^quj^fqca-user-to^^^ 

Refenmg^gainjjQrHG^ 20 
down-the-leftMght z buttoiis r 410^ 

sCTeecmaiFimageT r 608~are~contmually-decorj^ressedrand. 
displayed:in-the^ECD-screen"4O2~in^te^808^til z the^iiseT 
releases:therbutton . 

AfteTthTblitt6n-is:reteasTd^ 25 
beingidisplay^d-becomesrmersclectedjma 
pre^d : image::data^6j04:corresponcfo 
'iszfetchcd-from-thc=imagerfile^ 

resized-to~fifcthe = display~in-step-810.-=ln-a-preferred> 
embojdiment7z:as~the^conipressed : =image=604~is— being 30 
decompressed ;:me:screennau^im^ 
402:is:updated-wim=decompre1^d r image 
step 812. 

FIGS. 11C and 11D illustrate an example of a higher- 
resolution compressed image 811 replacing the screennail 35 
809 on the LCD screen 402 from top to bottom as the 
compressed image 604 is decompressed and resized. In an 
alternative embodiment, the compressed image 604 may be 
decompressed and resized in its entirety first and then 
displayed to replace the screennail image 608 in one step. 4 q 

In another preferred embodiment of the present invention, 
the play mode user interface may be further accelerated by 
optionally displaying the compressed image data 604. That 
is, if the screennail quality is such that its display on the 
LCD screen 402 is indistinguishable from the display of the 45 
compressed image data 604, then there is no reason to spend 
the time decompressing and displaying the compressed 
image data 604. Whether or not to display the compressed 
image data 604 depends on two factors: the resolution of the 
screennail image 608, which is determined by the compres- 50 
sion factor used to compress the screennail 608, and the 
resolution of the LCD screen 402. If the resolution of the 
screennail 608 matches or surpasses the resolution of the 
LCD screen 402, th en on ly the scr eennail 6 08 is displayed 
in play mode. In-tHis caserthe-camera-can belprogrammed 55 
to-mbmtor-whTther^il-^ 

dev^cefsuchli^Pe:monitor OKtelev^ion^viawmeiean^fS's 
viaWjacMf-so^hen theicompressed image data 608 isalso 
decorn^fe^sed^and^isplayed on"m^&r-resolutioli^evioe^as 

Continuing with the FIG. 11 A, if the user presses one of 
the navigation buttons 410 in step 814, then the decom- 
pressing process is interrupted (if not yet complete) in step 
816 and the next screennail image 608 is decompressed and 
displayed in step 808. It should also be understood that the 65 
process of decompressing the compressed image is also 
interrupted if the user changes modes. 
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Acc^&n^ly,-by-display^ when 
m^user-holds-dowB^naviption^ 

mrough:^rsked:imag e^mor^quickL y-than r m.coaventiona l 

a^ital=cameras-smce"decompressing=the~low^resolution' 

scrcennails-is-faster'man-^dc compressing^ 

-pressedrimages:^In^aa^tion >z si^^ 

mterrupts r caused-by-position-andrmodezC^^ 

may-abort-thecdecompression-^ 

c^pres^d-injtege-and-quic^ 

Ifoafcis^since^he^uttonfrakth^ 

whj^an : imagejsJ)ejng : o^ 

camerasrthe : camera^spond£:to7use^ 

the-responsiveness~of-miFdig^^ 

greatly-increase'dr 

In another aspect of the present invention, the compressed 
screennail image 606 are speculatively decompressed in the 
review and play modes to further accelerate the user inter- 
face of the digital camera. Referring again to FIG. 4A, recall 
that in the capture mode, the input buffers 538 are used as 
capture buffers to capture incoming image data. When the 
camera is placed into review and play modes, however, the 
input buffers 538 are typically unused. According to the 
present invention, these unused input buffers 538 are real- 
located as working memory 530 when the camera is placed 
into the review and play modes. 

Referring now to FIG. 12, a memory map of the DRAM 
is shown illustrating the reallocation of the input buffers as 
speculation buffers in accordance with the present invention. 
The DRAM 346 is shown as including (N) speculation 
buffers 850, which are used by a background process to 
speculatively decompress image data corresponding to 
images the user may potentially scroll to. By using part of 
the DRAM 346 as input buffers 358 to capture input data in 
one mode, and then using that same part of DRAM 346 as 
speculation buffers 850 to decompress image data in other 
modes the present invention provides for the multiple use of 
memory. 

During the speculative decompression of the present 
invention, the speculation buffers 850 are used to decom- 
press screennail images 608 and compressed images 604 in 
the background during review and play modes. If the user is 
currently in review mode and switches to play mode, or 
selects the next image while in play mode, the screennail for 
the selected image is displayed immediately since it has 
already been decompressed. As the user begins to scroll 
from image to image, the screennails that have already been 
decompressed are similarly displayed. If the user maintains 
position on the currently selected image long enough, then 
once all the speculation buffers 850 have been filled with 
decompressed screennails, the process begins to replace the 
screennail images in the speculation buffers 850 by decom- 
pressing their respective compressed image data 604. This 
way when the user switches to play mode or selects the next 
image while in play mode, the higher-resolution image is 
instantaneously displayed since it has already been decom- 
pressed. When this occurs, the step of displaying the screen- 
nail is skipped. 

Referring now to FIG. 13, a flow chart depicting the 
speculative decompression process is shown in a preferred 
embodiment of the present invention. The process begins 
when either the review or play modes are invoked in step 
900. Once this occurs, it is determined how many specula- 
tion buffers 850 are available for use in step 902. Given the 
number of speculation buffers 850 available, a speculation 
buffer organization is assigned around the currently selected 
image based on the scrolling method employed by the user 
in step 904. For example, the user may automatically 
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advance through the images by holding down the left/right 
navigation button 410 or by pressing a "play" button in 
which case the images are advanced at a preset rate. The user 
may also manually advance through the images by repeat- 
edly pressing either the left or right navigation buttons 410a 
and 4106. The buffer organization that is assigned in 
response to the scrolling method predicts which images will 
be displayed next and determines the order of screennail 
decompression accordingly. 

Referring now to FIG. 14A, the buffer organization that is 
assigned to the images in response to an automatic scrolling 
method is shown. Given M speculation buffers 850, the 
speculation buffers 850 are assigned such that the currently 
selected image N in a sequence of images is decompressed 
first. Thereafter, the order of screennail decompression 
extends from the selected image N to image N+l, image 
N+2, image N+3, image N+4, and so on. This order ensures 
that as the user continues to scroll in the same direction, the 
screennails 608 for the images ahead of the current image 
will be decompressed ahead of time and may be displayed 
without delay when they become the selected image. 

Referring now to FIG. 14B, the buffer organization that is 
assigned to the images in response to the manual scrolling 
method is shown. Given M speculation buffers 850 and a 
currently selected image N in a sequence of images, the 
speculation buffers 850 are assigned such that the currently 
selected image N in a sequence of images is decompressed 
first. Thereafter, the order of screennail 608 decompression 
alternates around the selected image N as follows: image 
N+l, image N-l, image N+2, image N-2, and so on. By 
speculatively decompressing the screennails 608 for the 
images neighboring the selected image, the screennails 608 
may be displayed without delay whether the user advances 
to the next or the previous image. 

Referring again to FIG, 13, after the buffer organization is 
assigned, the process gets (N), the number of the currently 
selected image, in step 906. It should be noted that at this 
point it must be determined whether the selected image is the 
first or last captured image, since speculative decompression 
cannot occur beyond the first or last image. If in review 
mode, then after getting (N) the process must also fetch the 
screennail 608 for the selected image (N) from the image's 
image data file 600, 

After getting (N) in step 906, it is determined whether a 
screennail update of any of the speculation buffers 850 is 
required in nearest neighbor order according to the assigned 
buffer organization in step 908. If an update necessary, then 
the it is determined whether a speculation buffer 850 is free 
in step 910. If a speculation buffer 850 is not free, then the 
speculation buffer 850 used to decompress the screennail for 
the image farthest away from the current image (N) and 
opposite to the current direction of scrolling is freed in step 
912. The freed speculation buffer 850 is then given to the 
speculation process in step 914 and is used to decompress 
the screennail 608 for the image that needs updating in step 
916. 

Referring again to step 908, if after getting (N) it is 
determined that a screennail update of the speculation buff- 
ers 850 is not required, meaning that all speculation buffers 
contain a decompressed screennail in accordance with the 
assigned buffer organization, then it is determined whether 
a compressed image data update of the speculation buffers 
850 is required in step 917. In no compressed image data 
update of the speculation buffers 850 is required, then all the 
speculation buffers 850 contain decompressed image data 
and the process waits until the current image (N) changes in 
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step 906. If a compressed image data update of the specu- 
lation buffers 850 is required in step 917, the compressed 
image data for the image needing updating is decompressed 
and resized in step 919. 

5 After either the screennail or the compressed image data 
has been decompressed, it is determined whether review or 
play mode has been terminated in step 918. If so, the 
speculative decompression process ends in step 920. If the 
review or play mode has not been terminated, then it is 

10 determined whether the number of available speculation 
buffers 850 has changed in step 922. This could occur for 
example when a previously used input buffer 538 becomes 
free and is reallocated as a new speculation buffer 850. 
If the number of available speculation buffers 850 has 

15 changed, then the process continues by determining how 
many speculation buffers 850 are available for use in step 
902. If the number of available speculation buffers 850 has 
not changed, then it is determined whether the user's scroll- 
ing method has changed in step 924. If the user's scrolling 

20 method has changed, then the process continues by assign- 
ing a speculation buffer organization accordingly, as 
described in step 904. If the user's scrolling method has not 
changed, then the screennail 608 for the currently selected 
image is fetched from its image data file 600, as described 

25 in step 906 and the process continues. 

Referring now to FIG. 15, a flow chart illustrating the 
process of accelerating the user interface of play mode using 
the speculative decompression process is shown. As 

3Q described in FIG. 11A, after play mode is invoked in step 
930, the screennail image 608 corresponding to the selected 
image is fetched in step 932, and decompressed and dis- 
played in step 934. Thereafter the speculation process is 
invoked in step 936. 

35 If the user presses and holds down the left/right buttons 
410 in step 938, then it is determined whether a decom- 
pressed screennail or decompressed high-resolution image 
for the next image is available from the speculation process 
in step 952. If a decompressed screennail or high-resolution 

40 image is available, then it is copied from the speculation 
buffer 850 to the frame buffer 536 for display in step 956. If 
a decompressed screennail or high-resolution image is not 
available in step 952, then the next screennail image 608 is 
decompressed and displayed in step 954 and the process 

45 continues at step 938. 

After the navigation button is released in step 938, which- 
ever image is currently being displayed becomes the 
selected image. It is then determined whether a decom- 
pressed high-resolution image is available for the selected 

50 image from the speculation process in step 940. If a decom- 
pressed high-resolution image is available, then it is copied 
from the speculation buffer 850 to the frame buffer 536 for 
display in step 942. 

If a decompressed high-resolution image is not available 

55 in step 940, then the compressed image data 604 corre- 
sponding to the selected image is fetched from the image file 
600 and decompressed and resized to fit the display in step 
944. In a preferred embodiment, as the compressed image 
604 is being decompressed, the screennail image 608 in the 

60 LCD screen 402 is updated with decompressed image block 
by block in step 946. If the user presses one of the navigation 
buttons 410 in step 948, then the decompressing process is 
interrupted (if not yet complete) in step 950. It is then 
determined whether a decompressed screennail or decom- 

65 pressed high- resolution image for the next image is available 
from the speculation process in step 952, and the process 
continues. 
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Accordingly, by speculatively decompressing the screen- 
nail images 608, the captured images can be more quickly 
accessed and reviewed in play mode, thereby facilitating 
user interaction. 

A method and system for accelerating the user interface of 
an image capture device has been disclosed. Through the 
present invention, the user interface is accelerated when 
accessing captured images through interaction of various 
features. In a first enhancement, as has been described 
above, an enhance image file is created for each image that 
contains a combination of a thumbnail, a screennail, and a 
full resolution compressed image. Through the use of the 
enhanced image file, the user interface in review mode is 
accelerated because the thumbnails can be displayed 
quickly; and the user may easily recognize images by 
providing a larger resized thumbnail on the display. In a 
another enhancement of the present invention, the user 
interface in play mode is accelerated by displaying the 
reduced resolution screennail image first and then updating 
it with higher resolution compressed image so that the user 
can quickly view an image without waiting for the com- 
pressed image to be decompressed. In a further enhancement 
of the present invention, the input buffers are reallocated to 
allow for the speculative decompression of such images. In 
so doing, the images can be navigated more rapidly via 
representations which can be seen quickly. Through the 
present invention the interaction rate and responsiveness to 
the user is increased significantly over conventional digital 
camera navigation systems. 

Although the present invention has been described in 
accordance with the embodiments shown, one of ordinary 
skill in the art will readily recognize that there could be 
variations to the embodiments and those variations would be 
within the spirit and scope of the present invention. For 
example, the accelerated user interface also applies to cam- 
eras having only two modes, but that have multiple naviga- 
tion screens within the "play mode" Accordingly, many 
modifications may be made by one of ordinary skill in the art 
without departing from the spirit and scope of the appended 
claims. 

What is claimed is: 

1. A method for accelerating a user interface of a digital 
camera having a display, a first mode for capturing images, 
a second mode for displaying captured images, and a navi- 
gation button, comprising the steps of: 

in response to the digital camera being placed into the 
second mode, displaying a set of thumbnail images on 
the display, such that all the thumbnail images in the set 
are displayed in alignment, wherein the aligned set of 
thumbnail images is based on a filmstrip metaphor that 
allows the user to quickly move forward and backward 
among the captured images chronologically according 
to date and time; 

scrolling the thumbnail images in response to a user 
pressing the navigation button, wherein an indication in 
the display indicates which of the thumbnail images is 
currently active, and wherein the thumbnail images are 
scrolled-off the display and replaced by new thumbnail 
images; and 

simultaneously displaying additional information corre- 
sponding to the currently active item in the display 
adjacent to the aligned set of thumbnail images, the 
additional information including, 
a resized thumbnail image that is a larger version of the 

active thumbnail image, and 
image information including dale of capture, and what 

media types are associated with the active image, 
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wherein the media types include at least one of a still 
image, a time lapse image, a burst image, and sound, 
wherein as the active thumbnail changes during 
scrolling, the resized thumbnail is updated accord- 

5 ingly. 

2. The method of claim 1 wherein the plurality of thumb- 
nail images and the resized thumbnail image are displayed 
using the thumbnail image data. 

3. The method of claim 2 wherein the resized image is 
1Q generated by multiplying the thumbnail images data by a 

multiplication factor. 

4. The method of claim 2 wherein the display is included 
on an image capture unit that includes a working memory 
and input buffers. 

5. Tne method of claim 4 wherein the thumbnail images 
15 are cached into the working memory. 

6. The method of claim 4 wherein the input buffers are 
partitioned into a draw buffer and a display buffer wherein 
the draw buffer contains information relating to a selected 
image and provides that information to the display buffer. 

20 7. The method of claim 1 in which the plurality of 

thumbnail images are cropped. 
8. The method of claim 7 wherein the resized image is 

generated by expanding the one of the plurality of cropped 

thumbnail images. 
25 9. The method of claim 7 which the plurality of thumbnail 

images are in landscape format. 

10. The method of claim 7 which the plurality of thumb- 
nail images are in true orientation and aspect ratio. 

11. The method of claim 10 wherein the plurality of 
30 captured images are stored in enhanced image files. 

12. The method of claim 5 wherein each of the enhanced 
image files comprises a compressed image data, a thumbnail 
image data associated with the compressed image and image 
tags associated with the compressed image data and the 

35 thumbnail image. 

13. A method for accelerating a user interface of a digital 
camera having a display, a first mode for capturing images, 
a second mode for displaying captured images, and a navi- 
gation button, comprising the steps of: 

40 in response to the digital camera being placed into the 
second mode, displaying a set of thumbnail images on 
the display, such that all the thumbnail images in the set 
are displayed in alignment; 
scrolling the thumbnail images in response to a user 

45 present the navigation button, wherein an indication in 
the display indicates which of the thumbnail images is 
currently active, and wherein the thumbnail images are 
scrolled-off the display and replaced by new thumbnail 
images; and 

50 simultaneously displaying additional information corre- 
sponding to the currently active item in the display 
adjacent to the aligned set of thumbnail images, the 
additional information including, 
a resized thumbnail image that is a larger version of the 
55 active thumbnail image, and 

image information including date of capture, and what 
media types are associated with the active image, 
wherein the media types include at least one of a still 
image, a time lapse image, a burst image, and sound, 
60 wherein when the user holds down of the navigation 

button, the thumbnail images are scrolled-off the 
display and replaced by new thumbnail images but 
the resized image is not updated to provide for fast 
browsing of the digital camera's content. 
65 14. A digital camera having a first mode for capturing 
images and a second mode for displaying captured images, 
comprising: 
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an image device for capturing image data; 

a memory coupled to the imaging device for storing the 
image data as captured images, wherein each of the 
captured images is associated with a representative 
thumbnail image; 

a display; 

a set of navigation buttons; and 

a processor coupled to the image device, the memory, the 
display, and to the set of navigation buttons for con- 
trolling operation of the digital camera, wherein the 
processor includes, 

means responsive to the digital camera being placed into 
the second mode for displaying a set of thumbnail 
images on the display, such that all the thumbnail 
images in the set are displayed in alignment, wherein 
the display of the aligned set of thumbnail images is 
based on a filmstrip metaphor which allows the user to 
quickly move forward and backward among the cap- 
tured images chronologically according to date and 
time; 

means for scrolling the thumbnail images in response to 
a user pressing one of navigation buttons, wherein an 
indication in the display indicates which of the thumb- 
nail images is currently active, and wherein the thumb- 
nail images are scrolled-off the display and replaced by 
new thumbnail images; and 

means for displaying additional information correspond- 
ing to the currently active item in the display adjacent 
to the aligned set of thumbnail images, the additional 
information including, 

a resized thumbnail image that is a larger version of the 
active thumbnail image, and 

image information including date of capture and what 
media types are associated with the active image, 
wherein the media types include at least one of a still 
image, a time lapse image, a burst image, and sound, 
wherein as the active thumbnail changes during 
scrolling, the resized thumbnail is updated accord- 
ingly. 

15. The system of claim 14 wherein the plurality of 
thumbnail images and the resized image are displayed using 
the thumbnail image data. 

16. The system of claim 15 wherein the resized image is 
generated by multiplying the thumbnail image data by a 
multiplication factor. 

17. The system of claim 14 in which the plurality of 
thumbnail images are cropped. 

18. The system of claim 17 wherein the display is 
included on an image capture unit that includes a working 
memory and input buffers. 

19. The system of claim 18 wherein the thumbnail images 
are cached into the working memory. 

20. The system of claim 19 wherein the input buffers are 
partitioned into a draw buffer and a display buffer wherein 
the draw buffer contains information relating to a selected 
image and provides that information to the display buffer. 
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21. The system of claim 17 wherein the resized image is 
generated by expanding the one of the plurality of cropped 
thumbnail images. 

22. The system of claim 17 in which the plurality of 
thumbnail images arc in landscape format. 

23. The system of claim 17 in which the plurality of 
thumbnail images are in true orientation and aspect ratio. 

24. The system of claim 19 wherein each of the enhanced 
image files comprises a compressed image data, a thumbnail 
image data associated with the compressed image and image 
tags associated with the compressed image data and the 
thumbnail image. 

25. The system of claim 21 wherein the plurality of 
captured images are stored in enhanced image files. 

26. A digital camera having a first mode for capturing 
images and a second mode for displaying captured images, 
comprising: 

an image device for capturing image data; 

a memory coupled to the imaging device for storing the 
image data as captured images, wherein each of the 
captured images is associated with a representative 
thumbnail image; 

a display; 

a set of navigation buttons, and 

a processor coupled to the image device, the memory, the 
display, and to the set of navigation buttons for con- 
trolling operation of the digital camera, wherein the 
processor includes, 

means responsive to the digital camera being placed into 
the second mode for displaying a set of thumbnail 
images on the display, such that all the thumbnail 
images in the set are displayed in alignment; 

means for scrolling the thumbnail images in response to 
a user pressing one of navigation buttons, wherein an 
indication in the display indicates which of the thumb- 
nail images is currently active, and wherein the thumb- 
nail images are scrolled-off the display and replaced by 
new thumbnail images; and 

means for displaying additional information correspond- 
ing to the currently active item in the display adjacent 
to the aligned set of thumbnail images, the additional 
information including, 

a resized thumbnail image that is a larger version of the 
active thumbnail image, and 

image information including date of capture and what 
media types are associated with the active image, 
wherein the media types include al least one of a still 
image, a time lapse image, a burst image, and sound, 
wherein when the user holds down one of the navi- 
gation buttons, the thumbnail images are scrolled-off 
the display and replaced by new thumbnail images, 
but the resized image is not updated to provide for 
fast browsing of the digital camera's content. 
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